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Visual Computing 



Function Plots and Height Fields 



• Visualization of 1 D or 2D scalar fields 



- 1 D scalar field: f2 <z R -» R 

- 2D scalar field: Qc R 2 ^ R 
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Function Plots and Height Fields 



• Function plot for a 1 D scalar field 

-2D Points 

{(s,f(s))\seR} 

- 1 D manifold: line 
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Function Plots and Height Fields 



• Function plot for a 2D scalar field 

- 3D Points 






{(s,t,f(s,t)\(s,t)eR 2 } 

- 2D manifold: surface 

Surface representations 

- Wireframe 

- Hidden lines 

- Shaded surface 
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„The Geometry of Images" 
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„The Geometry of Images" 
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„The Geometry of Images" 
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Isolines 



• Visualization of 2D scalar fields 

• Given a scalar function f .Ci^lR 

and a scalar value c e R 

• Isoline consists of points 

{(*, y)\f(x,y) = c} 

• If f() is differentiable and grad(f) * 0, then isolines are 
curves 

• Contour lines 
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Isolines 
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Isolines 



MB 
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Isolines 



• pixel by pixel contouring 

• straightforward approach: scanning all pixels for isovalue 

• input 

— f . (1 ,...,x max ) x (1 y max ) R 

- Isovalues /„..., I n and isocolors c 1 t ...,c n 

• algorithm 

for all (X,y) e(1,...,x max )x(1,...,y m j do 
for all ke { do 

if /f(x,y)-l k l < £ then 
draw ( X,y,C k ) 

• problem: isolinie can be missed if the gradient of f() is too large 
(despite range s) 



B 
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Visual Computing 




Isolines 



• Marching squares 

representation of the scalar function on a rectilinear grid 

- scalar values are given at each vertex f^fy 

- take into account the interpolation within cells 

- isolines cannot be missed 

- divide and conquer: consider cells independently of each other 
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Isolines 



• Which cells will be intersected ? 

Initially mark all vertices by + or - , depending on the 
conditions /•• > c , /•• < c 

• No isoline passes through cells (=rectangles) which have 
the same sign at all four vertices 

So we only have to determine the edges with different signs 





KWIHAACHEN 



Isolines 



• Only 4 different cases (classes) of combinations of signs 

• Symmetries: rotation, reflection, change + - 

• Compute intersections between isoline and cell edge, 
based on linear interpolation along the cell edges 
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Isolines 



• We can distinguish the cases by a decider 

• Mid point decider 

- Interpolate the function value in the center 

f center ^ ( f i,j f i+l,j f i,j+l f i+l,j+l) 

- If f center < c we chose the right case, otherwise we chose the left case 

+ 



Not always correct solution 





B Visual Computing Institute | Prof. Dr. Leif Kobbelt 
Computer Graphics and Multimedia 
Data Analysis and Visualization 




KWIHAACHEN 



Isolines 



• Asymptotic decider 

- Consider the bilinear interpolant within a cell 

- The true isolines within a cell are hyperbolas 





Asymptote 
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Visual Computing 
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Isolines 



• Interpolate the function bilinearly 

fix, y) = fu (1 - *)(1 - y) + f MJ x( 1 - y) + f iJ+ 1 (1 - x) y + / +1 ;+1 xy 



• Transform f() to 

/(x, v) = a(x -x 0 )iy-y 0 ) + /3 

• p is the function value in the 
intersection point 

of the asymptotes 
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Isolines 



• If |3 < c we chose the right case, otherwise we 
chose the left one 




+ 
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Isolines 



• Explicit transformation f() to 



f(x,y) = a(x-x 0 )(y-y 0 ) + /3 



can be avoided 

• Idea: investigate the order of intersection points either 
along x or y axis 

• Build pairs of first two and last two intersections 
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3D Scalar Field Visualization 
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Volumetric Representations 



• Implicit representation F(x,y,z) = 0 

• Signed distance function 

• Sample on a uniform cartesian grid 

• Trilinear interpolation 
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Volumetric Representations 
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F(i+u,j+v,k+w) = 
F 00 o(1-u)(1-v)(1-w) + 

F ioo u(1-v)(1-w) + 

FoioO-u) v(1-w) + 

F m u v w 
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Volumetric Representations 



• Indirect Rendering: 

-Isosurface extraction: Marching Cubes 

• Direct Rendering: 

-Ray Casting 
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Volume Data 



• discrete representation: 

F ijk = F(i Ax, j Ay, k Az) 

• piecewise polynomial (linear) interpolation 

• tri-linear functions per cell („voxel“) 

=> algebraic iso-surfaces of degree 3 

• approximation by a polygonal mesh 
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Surface Extraction 



• Find point samples on the iso-surface 

■ exploit voxel structure 

■ use function values 



• Connect neighboring samples 

■ exploit voxel neighborhood structure 

■ relation between voxels and polygons 



B Visual Computing Institute | Prof. Dr. Leif Kobbelt 
Computer Graphics and Multimedia 
Data Analysis and Visualization 




KWIHAACHEN 



26 



Surface Sampling 



in which voxel ? 
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Surface Sampling 



in which voxel ? 

F((i+u) Ax, (j+v) Ay, (k+w) Az) = 

(1-u)(1-v)(1-w)F i|k +(1-u)(1-v)wF iJkt1 + 

(1-u) v(1-w)F| j+1k +(1-u) * wF i|tiy + 

u (1-v)(1-w)F itljk + u (1 -v) w F i+1jk+1 + 

u v(1-w)F WJ , 1k + u V w F it1jtllwl + 

(u,v,w) g [0,1 ] 3 => min F ijk < F(u,v,w) < max F ijk 
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Surface Sampling 



in which voxel ? 

S C [F] passes through all (and only) voxels 
with min F ijk < c < max F ijk 
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Surface Sampling 



in which voxel ? 

S C [F] passes through all (and only) voxels 
with min F ijk < c < max F ijk 

how to find these voxels efficiently ? 
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Surface Sampling 



in which voxel ? 

S C [F] passes through all (and only) voxels 
with min F ijk < c < max F ijk 

how to find these voxels efficiently ? 

store /max {Fjj k ,Fy k+ -|,Fjj + -| k ,Fjj + -| k+ -|, 

^i+1 jk’ ^i+1 jk+1 > ^i+1 j+1 k> ^i+1 j+1 k+1 } 

- build octree 
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Min/Max Tree 



• store min/max for every voxel V ijk n 

• octree has children 

V n V n 

v 2i 2j 2k v 2i+1 2j+1 2k+1 

• propagate min/max values upwards 



• surface extraction: 
traverse only the relevant voxels 



0(n 3 ) => 0(n 2 logn) 
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Surface Sampling 



per voxel : ray intersection 
ray ... P + ^.Q 

intersection ... G(X) = F(P + X Q) = c 



solve cubic equation ... 
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Surface Sampling 



• per voxel : ray intersection 

• ray ... P + ^.Q 

•intersection ... G(X) = F(P + X Q) = 0 

• solve cubic equation ... 

• ray parallel to coordinate axis 



=> solve linear equation ... 




B 
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Problems / Bad Approximation 
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Surface Sampling 



• use additional information to improve 
iso-surface approximation 

• normal vector to iso-surface SJF]: 

VF(x,y,z) = [ 3F/ox, 3F/dy, 5F/5z ] 

• find surface samples by (approximately) 
intersecting tangent planes 
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Error Quadrics 



• squared distance to plane: 

v = (x,y,zSf, p = (a,b,c,d) T 
dist(/7, v) 2 = (p T , v) 2 = v T (pp T )v =: v T Q p v 




ad 



ab 


ac 


ad 


b 2 


be 


bd 


be 


c 2 


cd 


bd 


cd 


d 2 



• sum distances to vertex' planes: 



2]dist(/?,v) 2 = Yj v T Q p v = vT I^=:v r <3 v v 



planes p planes p 
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Error Quadrics 



• optimal point that minimizes the error: 



( 

I 

V p 



\ 



T 

H p n p 






v =- 






p h p 



V P 



p = 



f 



a p ,bp,c p ,d p 

v v J 

y='-n p with ^n p ||=1 



• solve using pseudo-inverse (SVD) 
(underdetermined vs. overdetermined) 



B Visual Computing Institute | Prof. Dr. Leif Kobbelt 
Computer Graphics and Multimedia 
Data Analysis and Visualization 




KWIHAACHEN 



38 



Surface Data 



• polygon meshes / triangle meshes 

M = ({PiMTj}) 

• compute samples 

■ on grid edges 

■ within voxels 

• compute faces (vertex connectivity) 

■ for each voxel 

■ for each grid edge 
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Marching Cubes [Lorensen/Cline '87] 



• extract surface patch for every grid cell 

■ classification by the signs at the corners 
(black, white, gray) 

• approximate samples 

■ linear interpolation of scalar distance values 
along cell edges 

• look-up table with pre-computed triangulations 

■ 2 8 entries, many symmetries 
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Visit Each Gray Cell ... 
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Compute Samples on Edges 
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Visual Computing 



Compute Samples on Edges 
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Compute Samples on Edges 
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Lookup Mesh Connectivity 
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Cell Connectivity Table 





Zj 


X 


7L7 


X. 


7 


.Zix 
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Visual Computing 





Extended Marching Cubes 



• same algorithmic principle 

• for each cell ... 

■ Find surface samples on the grid cell edges 

■ Evaluate surface normals at the sample points 

■ Feature detection 

■ Feature sampling 

■ Feature reconstruction 
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Feature Classification 



l 



Normal cone 
for a smooth (flat) 
non-feature region 
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Feature Classification 




Normal cone 
for a smooth (flat) 
non-feature region 
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Feature Classification 



Normal cone 
for an edge feature 
(one large angle) 
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Feature Classification 
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Feature Classification 



Normal cone 




Feature Detection 



• opening angles of the normal cone 

0 = max, j cn,, np 
9 = min k <n k , nj x nj> 



• edge features 

0 > 0 O , cp > cp 0 sharp edge 



• corner features 

0 > 0 O , cp <= cp 0 sharp comer 
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Feature Sampling 



• Each pair (p if nj defines a tangent element 

• Intersect tangent planes to approximate 
a piecewise smooth surface 

• Find least squares solution by SVD 

■ Overdetermined cases 

■ Underdetermined cases 

■ Suppress smallest singular value at edge 
features 
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Lookup Mesh Connectivity 
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Modified Lookup Table 



• Generate triangle fans centered around the 
feature sample 
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Feature Reconstruction 



feature 

detection 



feature 

sampling 



edge-flipping 
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Results 



• Mesh complexity 

■ Two additional triangles per feature sample 

■ Typically 1 0% overhead 

• Computation time 

■ 20% to 40% overhead 

• Improved approximation 

• Parameters 0q and cp 0 

■ False positive feature detection !? 

• Applications ... 
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CSG ... CAD / CAM 




CSG ... Milling Simulation 



257 x 257 x 257 
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Iso-Surface Extraction 
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65 x 65 x 65 



Iso-Surface Extraction 
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Volumetric Representations 



• Indirect Rendering : 

-Isosurface extraction: Marching Cubes 

• Direct Rendering : 

-Ray Casting 
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Volume Rendering 
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Volume Rendering 
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Volume Rendering 
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Ray Casting 



• Maximum Intensity Projection 
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Scalar value S 



0 ray 
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Maximum Intensity Projection 
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Absorption 



I(s 0 ) 
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Ray 
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Absorption 




Ray 



s 



I(S 0 ) q(s) ^ Ray 
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Ray Casting 



• Image order, for each pixel ... 

• Shoot rays from eye through each image plane 
pixel 

• Integrate color c & opacity // along the ray r 

L 

c(r) = | c(s)-e 0 ds 
o 
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Volumetric Representations 
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Opacity 



• base color c, opacity | u 

damping factor 1-a = 
emitted color ac 

• resulting (effective) color 

^ OC C + (1 -cl) C background 
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Ray Casting 



set color c(.) and opacity a(.) for all voxels 

for all pixels i/j = (u j5 vj 
find ray from eye through pixel : eye + Xd 
init c aGC ( £7j) = a acc (i/|) = 0 
for all samples jcj = (x j5 y j5 Zj) = eye + X ] d 

get c(Aj) and a(xj) by tri-linear interpolation 
composite with c acc (iij) and a acc (q) 
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Opacity Accumulation 



Continous compositing 

A 

L -J//(E+rD)dfr 



c(u t ) = | c( E + AD) • e 



dA 



o 



Discrete compositing 



K 



<■(«,-) = X 

7=0 L 



7-1 



) • a(Xj ) • (1 - a(x m )) 



m = 0 



with c(x k ) = c bkg , a(x k ) = 1 



B 
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Opacity Accumulation 




\ a K J 



( 

V 
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Opacity Accumulation 



s’ 




( r * ^ 



K 



\ a K J 



f c i^ 



\ a iJ 
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V 



a 0 J 
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Opacity Accumulation 



s' 



( r .. \ 



K 



\^K J 



'[1..K] 



f c i) 



\ a i) 
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V 



a 0 J 
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Opacity Accumulation 



c 



[0..K-1 ] 






( ^ 



K 



\ a K J 



f C i^ 



\ a iJ 
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V 



a 0 J 
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Back-to-Front Compositing 



Z 



7-1 

c(Xj)-a(Xj)-Y[( 1 



7=0 L 



m=0 



= c(* 0 )-ff(* 0 ) + 



I 



7=1 



7~1 

m=\ 



a Visual Computing Institute | Prof. Dr. Leif Kobbelt 
Computer Graphics and Multimedia 
Data Analysis and Visualization 



«OJ) 






•(l-«O 0 )) 
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Front-to-Back Compositing 



• Iterative accumulation j = 0 .. K 

C^C + CjOjil-d) 



d<-d + aj(l-d) 



with 



(i-«)=na-«j 

777=0 
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Transfer Functions 



• how to define the 

- base color c 

- opacity a 

• for each voxel ? 

•CT, MRI, ... 

• diffusion tensor imaging 




83 



Visual Computing Institute | Prof. Dr. Leif Kobbelt 
Computer Graphics and Multimedia 
Data Analysis and Visualization 




KWIHAACHEN 



Transfer Functions 



scalar value s 



T(s) 



emission RGB 
absorption A 



a 
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Transfer Functions 



a 

A 




++ 

i 
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Transfer Functions 



a 

A 



-i 

0 




+* 

1 
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Transfer Functions 



a 



N 



1 



V. 



0 
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Transfer Functions 



a 

n 




0 1 



+ Shading 






Visual Computing Institute | Prof. Dr. Leif Kobbelt 
Computer Graphics and Multimedia 
Data Analysis and Visualization 








KWIHAACHEN 



Transfer Functions 



a 

n 




0 1 



+ Shading 
+ Color coding 
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Absorption vs. MIP 
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Compositing Schemes 
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Depth 
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Intensity 



Compositing Schemes 



• Compositing: First 

• Extracts isosurfaces 
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Intensity 



Compositing Schemes 



• Compositing: Average 

• Produces basically an X-ray picture 
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Intensity 



Compositing Schemes 



• Maximum Intensity Projection (MIP) 

• Often used for magnetic resonance angiograms 

• Good to extract vessel structures 
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Intensity 



Compositing Schemes 



• Compositing: Accumulate 

• Emission-absorption model 

• Make transparent layers visible (- classification) 





Volume Shading 



Lighting / Shading 



Phong model, Gouraud shading 



Estimate normal by N(x,y,z) 



VF(x,y,z) 



|| VF(x,y,z) 

-Approximate VF(x,y,z) by central difference 



f 



1 



VF(x,y,z)=- 



F i x i+ ^y i ^z i )-F{x i _ l ,y i ,z i ) 



F ( x i+ ^y i ^z i )-F(x i ,y i ,z i ^ 1 ) 



B 



Visual Computing Institute | Prof. Dr. Leif Kobbelt 
Computer Graphics and Multimedia 
Data Analysis and Visualization 



| RWTH AACHEN 

Visual Computing i UNIVERSITY 



Volume Rendering Modes 



• Classification 

-assign spatial opacity values a(x,, y,, z,) 

-assign a v for isovalues F(x,y,z) = v (transfer 
function) 

-isosurface ... a v = 5(v=v 0 ) ... blur with radius r 

|VF(x,)|| = 0aF(x,) = v 
i )|| > 0 a ||F(.v,) - v|| < ||VF(^ )|| 
otherwise 



a(x,)=a r 



1 • I 

|VF( X 



0 



||VF(^)|| 
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Volume Rendering Modes 
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Volume Rendering Modes 




r A F 
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Volume Rendering Modes 




r A F 
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Ray Casting 



• Acceleration techniques 
-Spatial data structures (octree) 

■ Find and skip empty regions 

■ Find homogenous regions, use lower sample 
rate 



-Early ray termination 

■ Opacity threshold terminates ray traversal 

■ Requires front-to-back traversal 



Fast cell traversal (Bresenham-like) 
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